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Abstract. In this paper, we propose an effective search procedure that 
interleaves two steps: subproblem generation and subproblem solution. 
We mainly focus on the first part. It consists of a variable domain value 
ranking based on reduced costs. Exploiting the ranking, we generate, 
in a Limited Discrepancy Search tree, the most promising subproblems 
first. An interesting result is that reduced costs provide a very precise 
ranking that allows to almost always find the optimal solution in the 
first generated subproblem, even if its dimension is significantly smaller 
than that of the original problem. Concerning the proof of optimality, 
we exploit a way to increase the lower bound for subproblems at higher 
discrepancies. We show experimental results on the TSP and its time 
constrained variant to show the effectiveness of the proposed approach, 
but the technique could be generalized for other problems. 



1 Introduction 

In recent years, combinatorial optimization problems have been tackled with 
hybrid methods and/or hybrid solvers |11I18I13I19| . The use of problem relax- 
ations, decomposition, cutting planes generation techniques in a Constraint Pro- 
gramming (CP) framework are only some examples. Many hybrid approaches are 
based on the use of a relaxation R, i.e. an easier problem derived from the original 
one by removing (or relaxing) some constraints. Solving R to optimality provides 
a bound on the original problem. Moreover, when the relaxation is a linear prob- 
lem, we can derive reduced costs through dual variables often with no additional 
computational cost. Reduced costs provide an optimistic esteem (a bound) of 
each variable-value assignment cost. These results have been successfully used 
for pruning the search space and for guiding the search toward promising re- 
gions (see 0) in many applications like TSP [12], TSPTW US], scheduling with 
sequence dependent setup times [S] and multimedia applications 0]. 

We propose here a solution method, depicted in Figured based on a two step 
search procedure that interleaves (i) subproblem generation and (ii) subproblem 
solution. In detail, we solve a relaxation of the problem at the root node and we 
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use reduced costs to rank domain values; then we partition the domain of each 
variable in two sets, i.e., the good part Df ood and the bad part D\ ad . We search 
the tree generated by using a strategy imposing on the left branch the branching 
constraint Xi 6 Df ood while on the right branch we impose Xi G D\ ad . At each 
leaf of the subproblem generation tree, we have a subproblcm which can now be 
solved (in the subproblem solution tree). 

Exploring with a Limited Discrepancy Strategy the resulting search space, 
we obtain that the first generated subproblems are supposed to be the most 
promising and are likely to contain the optimal solution. In fact, if the ranking 
criterion is effective (as the experimental results will show), the first generated 
subproblem (discrepancy equal to 0) P^ , where all variables range on the good 
domain part, is likely to contain the optimal solution. The following generated 
subproblems (discrepancy equal to 1) P^ have all variables but the i-th ranging 
on the good domain and are likely to contain worse solutions with respect to 
p(°\ but still good. Clearly subproblems at higher discrepancies are supposed 
to contain the worst solutions. 

A surprising aspect of this method is that even by using low cardinality good 
sets, we almost always find the optimal solution in the first gener- 
ated subproblem. Thus, reduced costs provide extremely useful information 
indicating for each variable which values are the most promising. Moreover, this 
property of reduced costs is independent of the tightness of the relaxation. Tight 
relaxations are essential for the proof of optimality, but not for the quality of 
reduced costs. Solving only the first subproblem, we obtain a very effective in- 
complete method that finds the optimal solution in almost all test instances. 

To be complete, the method should solve all subproblems for all discrepancies 
to prove optimality. Clearly, even if each subproblem could be efficiently solved, if 
all of them should be considered, the proposed approach would not be applicable. 
The idea is that by generating the optimal solution soon and tightening the lower 
bound with considerations based on the discrepancies shown in the paper, we 
do not have to explore all subproblems, but we can prune many of them. 

In this paper, we have considered as an example the Travelling Salesman 
Problem and its time constrained variant, but the technique could be applied to 
a large family of problems. 

The contribution of this paper is twofold: (i) we show that reduced costs 
provide an extremely precise indication for generating promising subproblems, 
and (ii) we show that LDS can be used to effectively order the subproblems. 
In addition, the use of discrepancies enables to tighten the problem bounds for 
each subproblem. 

The paper is organized as follows: in Section [2] we give preliminaries on Lim- 
ited Discrepancy Search (LDS), on the TSP and its time constrained variant. 
In Section we describe the proposed method in detail. Section ^ discusses the 
implementation, focussing mainly on the generation of the subproblems using 
LDS. The quality of the reduced cost-based ranking is considered in Section |SJ 
In this section also the size of subproblems is tuned. Section presents the 
computational results. Conclusion and future work follow. 
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Subproblem Solution Trees 



Fig. 1. The structure of the search tree. 



2 Preliminaries 

2.1 Limited Discrepancy Search 

Limited Discrepancy Search (LDS) was first introduced by Harvey and Ginsberg 
|15| . The idea is that one can often find the optimal solution by exploring only 
a small fraction of the space by relying on tuned (often problem dependent) 
heuristics. However, a perfect heuristic is not always available. LDS addresses 
the problem of what to do when the heuristic fails. 

Thus, at each node of the search tree, the heuristic is supposed to provide the 
good choice (corresponding to the leftmost branch) among possible alternative 
branches. Any other choice would be bad and is called a discrepancy. In LDS, 
one tries to find first the solution with as few discrepancies as possible. In fact, a 
perfect heuristic would provide us the optimal solution immediately. Since this is 
not often the case, we have to increase the number of discrepancies so as to make 
it possible to find the optimal solution after correcting the mistakes made by the 
heuristic. However, the goal is to use only few discrepancies since in general good 
solutions are provided soon. 

LDS builds a search tree in the following way: the first solution explored is 
that suggested by the heuristic. Then solutions that follow the heuristic for every 
variable but one are explored: these solutions are that of discrepancy equal to 
one. Then, solutions at discrepancy equal to two are explored and so on. 

It has been shown that this search strategy achieves a significant cutoff of 
the total number of nodes with respect to a depth first search with chronological 
backtracking and iterative sampling |2()j . 
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2.2 TSP and TSPTW 

Let G = (V, A) be a digraph, where V = {1, . . . , n} is the vertex set and A = 
: i, j S the arc set, and let c,j > be the cost associated with arc 
(i, j) 6 A (with = +oo for each i 6 1/). A Hamiltonian Circuit (tour) of G is 
a partial digraph G — (V, A) of G such that: | A| = n and for each pair of distinct 
vertices vi,t>2 £ V, both paths from t>i to t>2 and from i>2 to v\ exist in G (i.e. 
digraph G is strongly connected). 

The Travelling Salesman Problem (TSP) looks for a Hamiltonian circuit G* = 
(V, A*) whose cost j)£A* c ij ^ s a minimum. 

A classic Integer Linear Programming formulation for TSP is as follows: 

v(TSP) = min c v X V ( 1 ) 

subject to = 1, j G V (2) 

^ acjj = 1, i eV (3) 

X) Z) > !> SC^,S^ (4) 

i£S j£V\S 

Xij integer, i,j G V (5) 

where = 1 if and only if arc is part of the solution. Constraints J5J 

and © impose in-degree and out-degree of each vertex equal to one, whereas 
constraints (@J impose strong connectivity. 

Constraint Programming relies in general on a different model where we have 
a domain variable Nexti (resp. Previ) that identifies cities visited after (resp. 
before) node i. Domain variable Costi identifies the cost to be paid to go from 
node i to node Nexti. 

Clearly, we need a mapping between the CP model and the ILP model: 
Nexti = j ^ Xij = 1. The domain of variable Nexti will be denoted as Di. 
Initially, Di = {1, . . . , n}. 

The Travelling Salesman Problem with Time Windows (TSPTW) is a time 
constrained variant of the TSP where the service at a node i should begin within 
a time window [aj,6j] associated to the node. Early arrivals are allowed, in the 
sense that the vehicle can arrive before the time window lower bound. However, 
in this case the vehicle has to wait until the node is ready for the beginning of 
service. 

As concerns the CP model for the TSPTW, we add to the TSP model a 
domain variable Starti which identifies the time at which the service begins at 
node i. 

A well known relaxation of the TSP and TSPTW obtained by eliminating 
from the TSP model constraints and time windows constraints is the Linear 
Assignment Problem (AP) (see |H] for a survey). AP is the graph theory problem 
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of finding a set of disjoint subtours such that all the vertices in V are visited and 
the overall cost is a minimum. When the digraph is complete, as in our case, AP 
always has an optimal integer solution, and, if such solution is composed by a 
single tour, is then optimal for TSP satisfying constraints Q. 

The information provided by the AP relaxation is a lower bound LB for the 
original problem and the reduced cost matrix c. At each node of the decision 
tree, each 2y estimates the additional cost to pay to put arc (i,j) in the so- 
lution. More formally, a valid lower bound for the problem where x%j — 1 is 
LB\ Xi .—i = LB + Cij. It is well-known that when the AP optimal solution is 
obtained through a primal-dual algorithm, as in our case (we use a CH — h adap- 
tation of the AP code described in 0), the reduced cost values are obtained 
without extra computational effort during the AP solution. The solution of the 
AP relaxation at the root node requires in the worst case 0(n 3 ), whereas each 
following AP solution can be efficiently computed in 0{n 2 ) time through a single 
augmenting path step (see [5] for details). However, the AP does not provide a 
tight bound neither for the TSP nor for the TSPTW. Therefore we will improve 
the relaxation in Section [3. II 

3 The Proposed Method 

In this section we describe the method proposed in this paper. It is based on two 
interleaved steps: subproblem generation and subproblem solution. The first step 
is based on the optimal solution of a (possibly tight) relaxation of the original 
problem. The relaxation provides a lower bound for the original problem and 
the reduced cost matrix. Reduced costs are used for ranking (the lower the 
better) variable domain values. Each domain is now partitioned according to 
this ranking in two sets called the good set and the bad set. The cardinality of 
the good set is problem dependent and is experimentally defined. However, it 
should be significantly lower than the dimension of the original domains. 

Exploiting this ranking, the search proceeds by choosing at each node the 
branching constraint that imposes the variable to range on the good domain, 
while on backtracking we impose the variable to range on the bad domain. By 
exploring the resulting search tree by using an LDS strategy we generate first 
the most promising problems, i.e., those where no or few variables range on the 
bad sets. 

Each time we generate a subproblem, the second step starts for optimally 
solving it. Experimental results will show that, surprisingly, even if the sub- 
problems are small, the first generated subproblem almost always contains the 
optimal solution. The proof of optimality should then proceed by solving the re- 
maining problems. Therefore, a tight initial lower bound is essential. Moreover, 
by using some considerations on discrepancies, we can increase the bound and 
prove optimality fast. 

The idea of ranking domain values has been previously used in incomplete 
algorithms, like GRASP [S]- The idea is to produce for each variable the so called 
Restricted Candidate List (RCL), and explore the subproblem generated only by 
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RCLs for each variable. This method provides in general a good starting point 
for performing local search. Our ranking method could in principle be applied 
to GRASP-like algorithms. 

Another connection can be made with iterative broadening |14) . where one 
can view the breadth cutoff as corresponding to the cardinality of our good sets. 
The first generated subproblem of both approaches is then the same. However, 
iterative broadening behaves differently on backtracking (it gradually restarts 
increasing the breadth cutoff). 

3.1 Linear relaxation 

In Section l2~2l we presented a relaxation, the Linear Assignment Problem (AP), 
for both the TSP and TSPTW. This relaxation is indeed not very tight and does 
not provide a good lower bound. We can improve it by adding cutting planes. 
Many different kinds of cutting planes for these problems have been proposed 
and the corresponding separation procedure has been defined |22| . In this paper, 
we used the Sub-tour Elimination Cuts (SECs) for the TSP. However, adding 
linear inequalities to the AP formulation changes the structure of the relaxation 
which is no longer an AP. On the other hand, we are interested in maintaining 
this structure since we have a polynomial and incremental algorithm that solves 
the problem. Therefore, as done in jl(J|. we relax cuts in a Lagrangean way, thus 
maintaining an AP structure. 

The resulting relaxation, we call it AP CMts , still has an AP structure, but 
provides a tighter bound than the initial AP. More precisely, it provides the same 
objective function value as the linear relaxation where all cuts are added defining 
the sub-tour polytope. In many cases, in particular for TSPTW instances, the 
bound is extremely close to the optimal solution. 

3.2 Domain partitioning 

As described in Section 12.21 the solution of an Assignment Problem provides 
the reduced cost matrix with no additional computational cost. We recall that 
the reduced cost of a variable Xij corresponds to the additional cost to be 
paid if this variable is inserted in the solution, i.e., Xij = 1. Since these variables 
are mapped into CP variables Next, we obtain the same esteem also for variable 
domain values. Thus, it is likely that domain values that have a relative low 
reduced cost value will be part of an optimal solution to the TSP. 

This property is used to partition the domain Di of a variable Nexti into 
Df od and D\ ad , such that A = Df ood U D\ ad and Df ood n D\ ad = for all 
i = 1, . . . , n. Given a ratio r > 0, we define for each variable Nexti the good set 
jjgood ^ selecting from the domain Z)j the values j that have the r * n lowest 
Cij. Consequently, D\ ad = D t \ Df ood . 

The ratio defines the size of the good domains, and will be discussed in 
Section [S] Note that the optimal ratio should be experimentally tuned, in order 
to obtain the optimal solution in the first subproblem, and it is strongly problem 
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dependent. In particular, it depends on the structure of the problem we are 
solving. For instance, for the pure TSP instances considered in this paper, a 
good ratio is 0.05 or 0.075, while for TSPTW the best ratio observed is around 
0.15. With this ratio, the optimal solution of the original problem is indeed 
located in the first generated subproblem in almost all test instances. 

3.3 LDS for generating subproblems 

In the previous section, we described how to partition variable domains in a 
good and a bad set by exploiting information on reduced costs. Now, we show 
how to explore a search tree on the basis of this domain partitioning. At each 
node corresponding to the choice of variable Xi, whose domain has been parti- 
tioned in D 9 i ood and D\ ad , we impose on the left branch the branching constraint 
Xi 6 Df ood , and on the right branch Xi £ D\ ad . Exploring with a Limited Dis- 
crepancy Search strategy this tree, we first explore the subproblem suggested by 
the heuristic where all variable range on the good set; then subproblems where 
all variables but one range on the good set, and so on. 

If the reduced cost-based ranking criterion is accurate, as the experimental 
results confirm, we are likely to find the optimal solution in the subproblem p(°) 
generated by imposing all variables ranging on the good set of values. If this 
heuristic fails once, we are likely to find the optimal solution in one of the n 
subproblems (P/ 1 ^ with i 6 {1, . . . , n}) generated by imposing all variables but 
one (variable i) ranging on the good sets and one ranging on the bad set. Then, 

("2) 

we go on generating n(n — l)/2 problems P^ all variables but two (namely i 
and j) ranging on the good set and two ranging on the bad set are considered, 
and so on. 

In Section ^ we will see an implementation of this search strategy that in 
a sense squeezes the subproblem generation tree shown in Figure ^ into a con- 
straint. 

3.4 Proof of optimality 

If we are simply interested in a good solution, without proving optimality, we 
can stop our method after the solution of the first generated subproblem. In this 
case, the proposed approach is extremely effective since we almost always find 
the optimal solution in that subproblem. 

Otherwise, if we are interested in a provably optimal solution, we have to 
prove optimality by solving all sub-problems at increasing discrepancies. Clearly, 
even if all subproblems could be efficiently solved, generating and solving all of 
them would not be practical. However, if we exploit a tight initial lower bound, 
as explained in Section 13.11 which is successively improved with considerations 
on the discrepancy, we can stop the generation of subproblems after few trials 
since we prove optimality fast. 

An important part of the proof of optimality is the management of lower and 
upper bounds. The upper bound is decreased as we find better solutions, and 
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the lower bound is increased as a consequence of discrepancy increase. The idea 
is to find an optimal solution in the first subproblem, providing the best possible 
upper bound. 

The ideal case is that all subproblems but the first can be pruned since they 
have a lower bound higher than the current upper bound, in which case we only 
need to consider a single subproblem. 

The initial lower bound LBo provided by the Assignment Problem AP cuts at 
the root node can be improved each time we switch to a higher discrepancy k. 
For i G {1, . . . , n}, let c* be the lowest reduced cost value associated with D\ ad , 
corresponding to the solution of AP cuts , i.e. c* = voin^ eD ba,d Cij. Clearly, a first 
trivial bound is LBo + m i n ie{i,...,ra} c* for all problems at discrepancy greater 
than or equal to 1. We can increase this bound: let L be the nondecreasing 
ordered list of c* values, containing n elements. L[i] denotes the i-th element in 
L. The following theorem achieves a better bound improvement |21|. 

Theorem 1. Fork G {l,...,n}, LB Q + J^ i=1 L\i] is a valid lower bound for the 
subproblems corresponding to discrepancy k. 

Proof. The proof is based on the concept of additive bounding procedures [6I7| 
that states as follows: first we solve a relaxation of a problem P. We obtain a 
bound LB, in our case LBo and a reduced-cost matrix c. Now we define a second 
relaxation of P having cost matrix c. We obtain a second lower bound LB^ 1 ' . The 
sum LB+LB^ is a valid lower bound for P. In our case, the second relaxation 
is defined by the constraints imposing in-degree of each vertex less or equal to 
one plus a linear version of the k- discrepancy constraint: X^ev ^2j£D bad Xi J = ^- 
Thus, Yli=i is exactly the optimal solution for this problem. □ 

Note that in general reduced costs are not additive, but in this case they are. 
As a consequence of this result, optimality is proven as soon as LBo+y^ _ 1 L[i] > 
UB for some discrepancy k, where UB is the current upper bound. We used this 
bound in our implementation. 

3.5 Solving each subproblem 

Once the subproblems are generated, we can solve them with any complete 
technique. In this paper, we have used the method and the code described in 
[T^] and in for the TSPTW. As a search heuristic we have used the one 
behaving best for each problem. 

4 Implementation 

Finding a subproblem of discrepancy k is equivalent to finding a set S C {1, . . . , n} 
with \S\ = k such that 



Next, G D\ ad for i G S, and 

Next, G Df ood for i G {1, . . . , n} \ S. 
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The search for such a set S and the corresponding domain assignments have 
been 'squeezed' into a constraint, the discrepancy constraint discr_cst. It takes 
as input the discrepancy k, the variables Nexti and the domains Df ood . Declar- 
atively, the constraint holds if and only if exactly k variables take their values 
in the bad sets. 

Operationally, it keeps track of the number of variables that take their value 
in either the good or the bad domain. If during the search for a solution in the 
current subproblem the number of variables ranging on their bad domain is k, 
all other variables are forced to range on their good domain. Equivalently, if the 
number of variables ranging on their good domain is n — k, the other variables 
are forced to range on their bad domain. 

The subproblem generation is defined as follows (in pseudo-code): 

for (k=0. .n) { 

add (discr_cst (k, next ,D_good) ) ; 

solve subproblem; 

remove (discr_cst (k.next ,D_good) ) ; 

} 

where k is the level of discrepancy, next is the array containing Nexti, and 
D_good is the array containing D 9 i ood for all i S {1, . . . , n}. The command solve 
subproblem is shorthand for solving the subproblem which has been considered 
in Section l3~5l 

A more traditional implementation of LDS (referred to as 'standard' in Ta- 
ble ^1 exploits tree search, where at each node the domain of a variable is split 
into the good set or the bad set, as described in Section 0751 In Tabled the 
performance of this traditional approach is compared with the performance of 
the discrepancy constraint (referred to as discr_cst in Table In this table 
results on TSPTW instances (taken from pQ) are reported. All problems are 
solved to optimality and both approaches use a ratio of 0.15 to scale the size 
of the good domains. In the next section, this choice is experimentally derived. 
Although one method does not outperform the other, the overall performance 
of the discrepancy constraint is in general slightly better than the traditional 
LDS approach. In fact, for solving all instances, we have in the traditional LDS 
approach a total time of 2.75 with 1465 fails, while using the constraint we have 
2.61 seconds and 1443 fails. 

5 Quality of Heuristic 

In this section we evaluate the quality of the heuristic used. On the one hand, 
we would like the optimal solution to be in the first subproblem, corresponding 
to discrepancy 0. This subproblem should be as small as possible, in order to be 
able to solve it fast. On the other hand, we need to have a good bound to prove 
optimality. For this we need relatively large reduced costs in the bad domains, 
in order to apply Theorem ^ effectively. This would typically induce a larger 
first subproblem. Consequently, we should make a tradeoff between finding a 
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0.08 


44 


0.04 


44 


rbg016b 


0.15 
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0.10 


43 


rbg017.2 


0.05 


14 


0.05 


14 


rbg017 


0.10 
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0.09 


47 


rbg017a 


0.09 


42 


0.09 


42 


rbg019a 


0.06 


30 


0.06 


30 


rbg019b 


0.12 


71 


0.12 


71 


rbg019c 


0.20 
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0.19 
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rbg019d 


0.06 


6 


0.06 


6 


rbg020a 


0.07 


5 


0.06 


5 





standard 


discr_cst 
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time 


fails 


time 


fails 


rb| 


;021.2 


0.13 


66 


0.13 


66 


rb| 


$021.3 


0.22 


191 


0.20 


158 


rb| 


;021.4 


0.11 


85 


0.09 


40 


rb| 


;021.5 


0.10 


45 


0.16 


125 


rb| 


;021.6 


0.19 


110 


0.2 


110 


rb| 


;021.7 


0.23 


70 


0.22 


70 


rb| 


;021.8 


0.15 


88 


0.15 


88 


rb| 


;021.9 


0.17 


108 


0.17 


108 


rb| 


;021 


0.19 


152 


0.19 


158 


rb| 


;027a 


0.22 


53 


0.21 


53 



Table 1. Comparison of traditional LDS and the discrepancy constraint. 



good first solution and proving optimality. This is done by tuning the ratio r, 
which determines the size of the first subproblem. We recall from Section 13.21 
that \Df° od \ < rn for i G {1, . . . , n}. 

In Tables and we report the quality of the heuristic with respect to the ra- 
tio. The TSP instances are taken from TSPLIB [3j and the asymmetric TSPTW 
instances are due to Ascheuer £Q . All subproblems are solved to optimality with 
a fixed strategy, as to make a fair comparison. In the tables, 'size' is the actual 
relative size of the first subproblem with respect to the initial problem. The size 
is calculated by ± \Df° od |/|A|- 



ratio=0.025 ratio=0.05 ratio=0.075 ratio=0.1 



instance 


size opt pr fails 


size opt pr fails 


size opt pr fails 


size opt pr fails 


grl7 

gr21 

gr24 

M26 

bayg29 

bays29 


0.25 1 2 
0.17 1 1 
0.17 12 
0.16 1 1 
0.14 1 2 127 
0.13 1 6 19k 


0.25 1 2 
0.23 1 6 
0.21 1 2 
0.20 1 4 
0.17 1 341 
0.16 2 54 


0.32 1 7 
0.23 1 6 
0.21 1 2 
0.24 1 327 
0.21 1 lk 
0.20 1 65 


0.32 1 7 
0.28 1 14 
0.26 1 39 
0.24 1 327 
0.21 1 lk 
0.20 1 65 


average 


0.17 0.33 2 22 


0.20 1.17 68 


0.24 1 68 


0.25 1 75 



Table 2. Quality of heuristic with respect to ratio for the TSP. 



The domains in the TSPTW instances are typically much smaller than the 
number of variables, because of the time window constraints that already remove 
a number of domain values. Therefore, the first subproblem might sometimes be 
relatively large, since only a few values are left after pruning, and they might be 
equally promising. 

The next columns in the tables are 'opt' and 'pr'. Here 'opt' denotes the 
level of discrepancy at which the optimal solution is found. Typically, we would 
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like this to be 0. The column 'pr' stands for the level of discrepancy at which 
optimality is proved. This would preferably be 1. The column 'fails' denotes 
the total number of backtracks during search needed to solve the problem to 
optimality. 

Concerning the TSP instances, already for a ratio of 0.05 all solutions are 
in the first subproblem. For a ratio of 0.075, we can also prove optimality at 
discrepancy 1. Taking into account also the number of fails, we can argue that 
both 0.05 and 0.075 are good ratio candidates for the TSP instances. 

For the TSPTW instances, we notice that a smaller ratio does not necessarily 
increase the total number of fails, although it is more difficult to prove optimality. 
Hence, we have a slight preference for the ratio to be 0.15, mainly because of its 
overall (average) performance. 

An important aspect we are currently investigating is the dynamic tuning of 
the ratio. 

6 Computational Results 

We have implemented and tested the proposed method using ILOG Solver and 
Scheduler |17I16| . The algorithm runs on a Pentium lGhz, 256 MB RAM, and 
uses CPLEX 6.5 as LP solver. The two sets of test instances are taken from the 
TSPLIB and Ascheuer's asymmetric TSPTW problem instances [T]. 

Table 0] shows the results for small TSP instances. Time is measured in 
seconds, fails again denote the total number of backtracks to prove optimality. 
The time limit is set to 300 seconds. Observe that our method (LDS) needs less 
number of fails than the approach without subproblem generation (No LDS). 
This comes with a cost, but still our approach is never slower and in some cases 
considerably faster. The problems were solved both with a ratio of 0.05 and 0.075, 
the best of which is reported in the table. Observe that in some cases a ratio of 
0.05 is best, while in other cases 0.075 is better. For three instances optimality 
could not be proven directly after solving the first subproblem. Nevertheless the 
optimum was found in this subproblem (indicated by objective 'obj' is 'opt'). 
Time and the number of backtracks (fails) needed in the first subproblem are 
reported for these instances. 

In Table El the results for the asymmetric TSPTW instances are shown. Our 
method (LDS) uses a ratio of 0.15 to solve all these problems to optimality. It 
is compared to our code without the subproblem generation (No LDS), and to 
the results by Focacci, Lodi and Milano (FLM2002) [H]. Up to now, FLM2002 
has the fastest solution times for this set of instances, to our knowledge. When 
comparing the time results (measured in seconds), one should take into account 
that FLM2002 uses a Pentium III 700 MHz. 

Our method behaves in general quite well. In many cases it is much faster 
than FLM2002. However, in some cases the subproblem generation does not pay 
off. This is for instance the case for rbg040a and rbg042a. Although our method 
finds the optimal solution in the first branch (discrepancy 0) quite fast, the initial 
bound LB is too low to be able to prune the search tree at discrepancy 1. In those 
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Table 3. Quality of heuristic with respect to ratio for the asymmetric TSPTW. 
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* Optimality not proven directly after solving first subproblem. 



Table 4. Computational results for the TSP. 
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Table 5. Computational results for the asymmetric TSPTW. 
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Table 6. Computational results for 
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first subproblem of the asymmetric 
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cases we need more time to prove optimality than we would have needed if we 
did not apply our method (No LDS). In such cases our method can be applied as 
an effective incomplete method, by only solving first subproblem. Table El shows 
the results for those instances for which optimality could not be proven directly 
after solving the first subproblem. In almost all cases the optimum is found in 
the first subproblem. 

7 Discussion and Conclusion 

We have introduced an effective search procedure that consists of generating 
promising subproblems and solving them. To generate the subproblems, we split 
the variable domains in a good part and a bad part on the basis of reduced costs. 
The domain values corresponding to the lowest reduced costs are more likely to 
be in the optimal solution, and are put into the good set. 

The subproblems are generated using a LDS strategy, where the discrepancy 
is the number of variables ranging on their bad set. Subproblems are considerably 
smaller than the original problem, and can be solved faster. To prove optimality, 
we introduced a way of increasing the lower bound using information from the 
discrepancies. 

Computational results on TSP and asymmetric TSPTW instances show that 
the proposed ranking is extremely accurate. In almost all cases the optimal 
solution is found in the first subproblem. When proving optimality is difficult, 
our method can still be used as an effective incomplete search procedure, by only 
solving the first subproblem. 

Some interesting points arise from the paper: first, we have seen that reduced 
costs represent a good ranking criterion for variable domain values. The ranking 
quality is not affected if reduced costs come from a loose relaxation. 

Second, the tightness of the lower bound is instead very important for the 
proof of optimality. Therefore, we have used a tight bound at the root node and 
increased it thus obtaining a discrepancy-based bound. 

Third, if we are not interested in a complete algorithm, but we need very 
good solutions fast, our method turns out to be a very effective choice, since the 
first generated subproblem almost always contains the optimal solution. 

Future directions will explore a different way of generating subproblems. Our 
domain partitioning is statically defined only at the root node and maintained 
during the search. However, although being static, the method is still very effec- 
tive. We will explore a dynamic subproblem generation. 
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